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Application  of  Efficient  Methods  for  Inspection  Sensitivity 


Jose  Garza1  and  Harry  Mill  water  Jr.,  Ph.D2 
University  of  Texas  at  San  Antonio,  San  Antonio,  TX,  78249 


Nondestructive  evaluation  (NDE)  inspections  play  a  vital  role  in  the  reliability  of 
structural  components.  NDE  inspecitons  are  simulated  using  a  Probability -of-Detection 
curve  (POD)  that  is  obtained  experimentally.  In  this  paper  a  methodology  using  the 
expectation  operator  was  developed  to  obtain  the  sensitivity  of  the  Probability-of-Failure 
(POF)  with  respect  to  parameters  of  the  POD  via  Monte  Carlo  Sampling.  The  methodology 
scales  to  any  number  of  inspections  and  can  be  integrated  with  existing  Monte  Carlo 
sampling  methods.  Sensitivities  of  the  probability -of-failure  with  respect  to  the  parameters 
of  a  POD  curve  were  calculated  for  several  numerical  examples  then  compared  against 
analytical  and  numerical  finite  difference  solutions. 


Nomenclature 


mx) 

f{n\x) 
POD{6,x ) 
CPOD(d,x) 
X 
6 

c{6) 

P Det 

P 

1  NoDet 

P(n)f 

dPn)f/dd 

VW 


crack  size  probability  distribution  before  inspection 
crack  size  probability  distribution  after  nth  inspection 
Probability  of  detection  curve 
complementary  POD,  equals  1  minus  POD 
crack  size  random  variable 
parameter  of  POD  curve 

scaling  parameter  such  that  the  integral  of  f'(6,x)  equals  one 
probability  of  detecting  a  crack 
probability  of  not  detecting  a  crack 
probability  of  failure  after  nth  inspection 

probability  of  failure  sensitivity  with  respect  to  6  after  nth  inspection 
expected  value  operator  with  respect  to  f(n\x) 


1  Master’s  Student,  Mechanical  Engineering  Department 

2  Associate  Professor,  Mechanical  Engineering  Department,  EB  3.04.50,  AIAA  Member 
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N(n)  number  of  samples  generated  from  f(n\x).  N{"}  =  Nin) Dei  +  Nin)NoDei 

A ^De,  number  of  samples  detected  by  the  nth  inspection  process  and  removed 

N1 "  *  NoDet  number  of  samples  not  detected  by  the  nth  inspection  process 


I.  Introduction 


rjnHE  POD  curve  has  been  seen  as  the  “formal  measure  of  quantifying  NDT  reliability”.2  The 
procedures  used  to  create  a  POD  take  on  the  following  sequence  of  events:  create  flaw 
specimens,  inspect  specimens  with  an  NDT  method,  obtain  results,  then  plot  the  POD  curve  as  a 
function  of  flaw  size.2  Probabilistic  sensitivity  analysis  proves  to  be  an  essential  part  of 
engineering  design.  Kulkarni  has  presented  a  method  that  optimizes  the  cost-effectiveness  of 
multiple  inspections  based  on  each  inspection’s  POD  curve.  His  damage  tolerance  approach  for 
when  inspections  should  occur  is  based  on  three  factors:  macro  crack  initiation,  macro  crack 
growth,  and  component  inspection.6  Research  into  on  board  sensors  that  can  detect  cracks 
continues.  For  instance,  Shook  et.  al  discussed  the  effect  of  recurring  automated  inspections  on 
probability-of-failure  estimates  using  sensor  performance  POD  curves.5  The  objective  of  this 
paper  is  to  present  an  MCS  method  of  obtaining  sensitivities  based  on  POD  parameters. 
Sensitivities  are  critical  when  evaluating  the  fatigue  life  of  a  particular  component  and  allow  the 
assessment  of  the  crucial  parameters,  which  affect  the  POF.  By  knowing  which  parameters  of  a 
POD  most  affect  the  POF,  the  design  and  inspection  protocol  can  be  optimally  modified. 

The  methodology  developed  here  is  to  explicitly  differentiate  the  equations  to  determine  the 
probability-of-failure  with  respect  to  the  parameters  of  the  POD  curves  then  integrate  these 
equations  using  the  same  Monte  Carlo  sampling  method  as  used  to  determine  the  POF.  As  a 
result,  accurate  derivatives  can  be  obtained  without  any  additional  calculations  since  the  same 
samples  used  to  compute  the  POF  are  used  to  compute  the  sensitivities. 


II.  Methodology 

Fet  /( jc)  represent  the  crack  size  PDF  before  inspection.  Note  the  initial  samples  will  be 
available  from  / (x) .  However,  during  the  inspection  process,  the  detected  samples  are  filtered 
out.  The  samples  after  each  inspection,  Nn,  simulate  the  samples  that  would  be  generated  from 
the  PDF  f(n\x),  where  n  denotes  the  current  inspection.  Thus,  it  is  beneficial  to  write  the 
equations  in  terms  of  f(n>(x)  and  not  fix) ,  since  the  equations  are  developed  using  the 
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A.  Formulation 

The  crack  size  PDF  before  inspection  is  /<H_1)(x).  The  crack  size  PDF  after  an  inspection 
is  fin)(9,x)  =  c(6)  ■  CPOD(6,x)fn-V)(x) ,  where  CPOD(6,x)  =  1  - POD(0,x),  POD(0,x )  is  the 
probability-of-detection  of  the  nth  inspection,  6  represents  the  parameters  of  the  POD(9,x) , 
c(9)  denotes  a  scaling  parameter  such  that  the  integral  over  the  entire  domain  of 


f{n\G,x)  equals  one,  e.g.,  c("  '(6)  =  1  /  j CPOD(0,x)f("  l\x)dx .  Note,  c(0)  depends  on  0  but 


not  X. 

The  probability  of  detecting  a  crack  from  the  nth  inspection  is 

Pin)De,=  \POD(0x)fin-'\x)dx*N^ 

where  Pf  '^Det  denotes  the  number  of  samples  that  were  detected  and  N{"]  denotes  the  total 
number  of  samples  used  for  inspection  n,  and  the  probability  of  missing  a  crack  is 

P(n)NoDe,  =  j(l -POD(0,x))f(n~l\x)dx  « 

where  N(n)NoDet  denotes  the  number  of  samples  that  were  not  detected. 

The  probability-of-failure  after  inspection  can  be  determined  as 

pf\0)  =  1 1(x)f"\e,x)dx =E  [/(*)] »  -T 

-00  ^  i=  1 


(1) 


where  7(x)  denotes  the  indicator  function  which  is  one  in  the  failure  domain  and  zero  otherwise, 
and  E  M  [•]  represents  the  expected  value  operator  with  respect  to  f(n\x). 

The  sensitivity  of  the  probability-of-failure  with  respect  to  a  parameter  of  the  POD  curve  9, 
can  be  written 
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dP\ 


(«) 


dG 


=  j  I(x)c(G)  ■  CPOD(0,x)f(n-x\x)dx  = 


\i(XM.cPomx^X*\ §7+ = 

- ! - U 

J  1^9  c  ^9  CPOD(<9,x)J 


(2) 


Using  the  substitution  Q (G,x)  =  ^^^-2^- - - -  for  brevity,  the  sensitivity  can  be 

6  dG  CPOD(G,x )  J  J 


written 


~h-=  \i{x)\^---Q.{e,xytf(n\e,x)dx 
dG  IdG  c  J 


(3) 


1 

The  term - can  be  determined  as  follows.  Define  L  as 

dG  c 


L  =  ]  CPOD(G,x )  •  f(n~l)dx 


then 


do  _  dL  _  d 
~dG~~dG~~d6 


)  CPOD(G,x)  ■  f(n~l\x)dx 


-  J  JCPOD(G,x)  y(*-i)(x)  A  ] CPOD{G,x)-  f(n~l\x)dx 
dQ  Loo 

=  c2  \dPOD^X)  fn-X){x)dx 


V2 


(4) 


Therefore, 


&i_=c<cPomx)  f„_n 

dGc  J  dG 

j  Q(G,x)  ■  c  ■  CPOD(G,x)f("-'>(x)dx  = 
|q  (G,x)f(n\G,x)dx  = 

Ef(n)[Q(G,x)] 


(5) 


1 

Note  that - is  a  function  of  G  but  not  X,  therefore,  this  term  can  be  extricated  from  the 

dGc 


integral  with  respect  to  X  and  Eq.  (3)  becomes 
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^-  =  ~  \l(x)r\0,x)<k-  ll(x)mx)f\0,x)dx 

d9  d9  c 


Substituting  P'!-  = 


]/(*)/' 


(x) dx  and  the  corresponding  term  for - from  Eq.  (5)  yields 

d9c 


{q  (9,x)fin\9,x)dx-  \l(x)Q.(9,x)fn)(9,x)dx  ■. 


PfEfin)  [0(0,*)]  -EfW  [/(x)Q(<9,x)] 


B.  Numerical  implementation 

The  probability-of-failure  and  its  sensitivity  with  respect  to  9  are  determined  by  several 
integrals,  see  Eqs.  (1,7).  The  integrals  can  be  estimated  by  approximating  the  expected  value 
operator  using  sampling  methods,  e.g.,  Monte  Carlo,  Latin  hypercube,  importance  sampling,  etc. 
Note,  that  the  expectations  are  with  respect  to  the  after  inspection  pdf. 

The  necessary  integrals  can  be  approximated  using  sampling  as 


/  jfn) 


,  X<") 


--  =  Ef,[Q (0,x,)] 


Efw  [7(x)Q(<9,x)]  «  — — y 


Calculation  procedure 

Accumulate  the  following  sums 
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(12) 


£=£q(6U;) 

i=  1 


7V(M) 

C=X/(x,)Q(6U,) 


Z=1 


(13) 


Then, 


p(»)  „ 

rf  r 

*A/N(n) 

(14) 

dp; 

dO 

*Pj.n)B/N(n)-C/N(n) 

(15) 

Numerical  Examples 

A  simple  example  problem  is  solved  for  which  an  exact  analytical  solution  can  be 
determined.  The  problem  is  solved  with  a  linear  POD  curve  and  a  lognormal  POD  curve.  The 
problem  consists  of  two  inspections  with  only  one  random  variable,  the  crack  size  and  without 
any  crack  growth. 

Linear  POD  Numerical  Example 

The  probability-of-failure  and  its  sensitivities  with  respect  to  the  parameter  of  a  linear  POD 
curve,  6X  and  02,  were  computed  for  two  inspections  using  Monte  Carlo  sampling.  An  initial 
sample  size  of  three  million  samples  was  used  for  the  first  inspection.  Detected  samples  were 
then  removed  (no  repair)  and  the  samples  not  detected  were  then  used  in  the  second  inspection. 
To  verify  the  equations,  the  Monte  Carlo  sampling  results  were  compared  to  analytical  and  finite 
difference  results.  The  results  for  the  first  inspection  are  shown  in  Table  1  and  the  second 
inspection  can  be  seen  in  Table  2.  In  the  linear  case,  the  sensitivities  for  both  inspections  show 
that  increasing  the  slope  of  the  POD  curve  will  result  in  a  decrease  in  the  POF. 

1.  First  Inspection 

The  PDF  before  the  first  inspection  was  defined  by 
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208. 3x  0<x<0.06 

/(x)  =  120-125x  0.06  < x  < 0.16 
0  x>0.16 

and  can  be  seen  in  Figure  1 .  The  POD  curve  used  for  the  first  inspection  was  chosen  as 

0  x  <0 

PODl(x)  =  <  8x  0<x<l/8 
1  x  >  1/8 

and  can  be  seen  in  Figure  2,  i.e.  6j  =  8. 

The  posterior  PDF  can  be  written 

0  x  <0 

2.3785 -(l-8x)-(208.3x)  0<x<0.06 

2.3785  •  (1  -  8x)  •  (20  -  125x)  0.06  <  x  <  1/8 
0  x  >  1/8 

where  2.3785  is  the  scaling  parameter,  c,  for  the  first  inspection.  The  failure  criterion  was  X  > 
0.1.  The  probability-of-failure  P(1)/after  the  first  inspection  can  then  be  calculated  by 

p';\0)= 

0.1  N  i=  1 

2.  Second  Inspection 

A  linear  POD  with  a  slope  of  Gx=  9  was  used  for  the  second  inspection  process. 

0  x  <0 

POD2(x)  =  \  9x  0<x<1/9 
1  x  >  1/9 

The  updated  PDF  for  the  second  inspection  given  the  scaling  parameter  is  now 

0  x  <0 

4.6071  •  (1  -  8x)(l  -  9x)(208.3x)  0  <  x  <  0.06 

4.607 1  •  (1  -  8x)(l  -  9x)(20  - 1 25x)  0.06  <  x  <  1  /9 
0  x  >1/9 

The  scaling  parameter  c2  is  now  4.6071.  Figure  3  shows  the  PDF  pre-inspection  and  post-inspection  for  both  cases. 

The  results  for  the  POF  and  its  sensitivity  with  respect  to  the  slope  of  the  POD  curves  are 
shown  in  Table  1. 

B.  Lognormal  POD  Numerical  Example 
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A  second  example  was  implemented  with  lognormal  PODs,  shown  in  Figure  4.  The  POD 

curves  are  defined  by  the  equation  POD(x )  =  r-L — Exp[-  where  /u  and  <7  are  the 

^jlngx  2g 

mean  and  standard  deviation  of  X  and  A  and  g  are  the  mean  and  standard  deviation  of  the 
log(X).  The  same  piecewise  PDF  from  the  previous  example  was  used  as  the  initial  crack  size. 
The  lognormal  POD  parameters  for  the  inspections  were  //,  = .  06,  cr,  =  .02  and  // 2  =  .03, 
<r2  =  .02.  Monte  Carlo  sampling  and  analytical  results  for  both  inspections  are  shown  in  Table  3 
and  4.  A  history  of  the  PDF  after  each  inspection  can  be  seen  in  Figure  5. 

C.  Fatigue  Example 

An  example  problem  considering  fatigue  crack  growth  was  computed  using  the  Paris  Law 
(Stage  II)  crack  growth  model  of  the  form  da/dN  =  C(AX)" .  Two  linear  POD,  6]  =  #,=1636.72, 
inspections  were  performed  for  this  example.  The  initial  crack  size  in  inches  was  modeled  as  a 
random  variable  with  a  lognormal  distribution  L[5.951E-4,3.344E-4],  Random  variables  C  and  n 
were  obtained  experimentally  with  distributions  and  parameters  of  N[log  (-10.09),  log  (0.1570)], 
N[3.8 13,0. 1456].  The  correlation  between  C  and  n  was  pcn=  -.9751.  The  fracture  toughness  was 
50  ksi-in1/2  and  constant  amplitude  loading  with  an  R  ratio  of  zero  and  a  maximum  load  of  70ksi 
was  applied.  The  critical  crack  size  was  0.130  inches.  With  a  critical  crack  size  known,  an  MCS 
code  was  used  to  calculate  the  average  number  of  cycles  to  failure  for  1E5  samples,  which  was 
70,000.  It  was  arbitrarily  chosen  that  the  inspection  would  occur  at  ten  and  forty  percent  of  the 
Nf ,  7,000  and  28,000. 

For  one  run  using  MCS,  crack  growth  was  generated  to  7,000  cycles.  If  a  crack  was  detected, 
future  crack  growth  was  aborted  and  a  new  MC  sample  generated  and  analyzed.  If  not  detected, 
the  sample  was  used  to  calculate  the  POF  and  the  sensitivities  of  the  POF  with  respect  to  the 
POD  parameters.  The  undetected  crack  was  allowed  to  continue  to  grow  and  was  then 
reevaluated  at  the  second  inspection  of  28,000  cycles.  The  inspection  process  was  repeated  for 
the  inspection  two. 

Tables  5  and  6  contain  the  results  from  the  fatigue  example.  As  seen  in  the  previous  case  of 
the  linear  POD,  the  POF  decreases  as  the  slope  increases.  Updated  PDFs  after  each  inspection 
are  shown  in  Figure  6  and  7.  In  both  cases,  the  PDF  shifts  to  the  left  after  each  inspection,  which 
graphically  displays  a  decrease  in  failure  after  each  inspection. 
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III.  Conclusion 

A  methodology  was  presented  such  that  the  sensitivity  of  the  POF  with  respect  to  the 
parameters  of  the  POD  curve  of  the  inspection  process  can  be  obtained  with  high  accuracy  for 
negligible  cost.  The  methodology  is  formulated  in  terms  of  expected  value  operators  such  that 
traditional  sampling  methods  can  be  used,  or,  more  likely,  the  additional  equations  needed  to 
compute  the  sensitivities  can  be  integrated  with  existing  damage  tolerance  analysis  codes.  The 
methodology  was  demonstrated  using  three  example  problems  and  the  sensitivities  compared  to 
analytical  or  numerical  derivatives.  The  agreement  in  all  cases  was  very  close. 
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Appendix 


Table  1.  First  Inspection  Sensitivity  for  Linear  POD 


Monte  Carlo 

Analytical 

Finite  Difference 
[2%  forward 
difference) 

pO) 

J  insp 

0.038495 

0.038402 

- 

af  / 

J  insp  / 

/ffl i 

-0.033842 

-0.033589 

-0.032794 

Failure  Criterion:  P[x  >0.1  in.]  *Samples:  3E6 


Table  2.  Second  Inspection  Sensitivity  for  Linear  POD 


Monte  Carlo 

Analytical 

Finite  Difference 
[2%  forward 
difference) 

p(2) 

^  f. 

J  insp 

0.003032 

0.003086 

- 

gpf>  / 

/dd1 

-0.005597 

-0.005422 

-0.005113 

Failure  Criterion:  P[x  >  0.1  in.]  *Samples:  1,260,826 
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Table  3.  First  Inspection  Sensitivities  for  Lognormal  POD  //,  =  .06  ,  a,  =  .02 


Monte  Carlo 

Analytical 

MC/Analvtical 

p0) 

rf 

0.009358 

0.009265 

1.010 

cPf  / 

/d\ 

0.05444 

0.05358 

1.016 

a?/ 

/<%i 

0.1384 

0.1350 

1.025 

cPf  / 

AM 

0.2875 

0.2893 

0.9938 

cPf  / 

/dox 

1.860 

1.811 

1.027 

Failure  Criterion:  P[x  >  0.1  in.]  *Samples:  1E6 


Table  4.  Second  Inspection  Sensitivities  for  Lognormal  POD  fj,2  =  .03  ,  cr2  =  .02 


Monte  Carlo 

Analytical 

MC/Analvtical 

p(2) 

rf 

0.0002672 

0.0002628 

1.017 

dP?]/ 

/d\ 

0.0008293 

0.0008080 

1.026 

cP'f/ 

0.002732 

0.002650 

1.031 

cPf/ 

AM 

-0.01007 

-0.009603 

1.049 

^P‘2)/ 

/dox 

0.05656 

0.05480 

1.032 

Failure  Criterion:  P[x>  0.1  in.]  *Samples:  375,517 
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Table  5.  First  Inspection  Sensitivities  for  Fatigue  Example 


Monte  Carlo 

Finite  Difference 
£.2%  forward 
difference) 

p(  1) 
r  f. 

J  insp 

3.109E-5 

- 

dPf  / 

/d6 1 

-3.141E-6 

-3.924E-6 

Failure  Criterion:  P[x  >  0.000606  in.]  *Samples:  1E8 


Table  6.  Second  Inspection  Sensitivities  for  Fatigue  Example 


Monte  Carlo 

Finite  Difference 
(.2%  forward 
difference) 

p(  2) 

^  f. 

J  insp 

.4595 

- 

3Pf>  / 

/dd1 

-0.03283 

-0.03093 

Failure  Criterion:  P[x  >  0.000606  in.]  *Samples:  4,439,905 
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Prior  to  Inspections 


Figure  1.  Crack  Size  PDF  Prior  to  Inspection 


13 

American  Institute  of  Aeronautics  and  Astronautics 


POD 


Linear  POD  Curves 


Figure  2.  Linear  Probability-of-Detection  Curves,  Slopei=8,  Slope2=9 


14 

American  Institute  of  Aeronautics  and  Astronautics 


PDF  History 


Figure  3.  Updated  PDFs  After  Linear  POD  Inspections 
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Figure  4.  Lognormal  POD  Curves,  //,  =  .06,  cr,  =  .02,/z2  =  .03,  <t2  =  .02 


16 

American  Institute  of  Aeronautics  and  Astronautics 


PDF  History 


^^--Second  Inspections 


0.08 

Crack  size  (in) 


Figure  5.  Updated  PDFs  After  Lognormal  Inspections 
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Figure  6.  Updated  PDFs  at  First  Inspection 


18 

American  Institute  of  Aeronautics  and  Astronautics 


2nd  Inspection  at  .15Nf  Cycles 


Acknowledgments 

This  work  was  supported  under  Air  Force  Contract  FA8650-07-C-5060,  with  Dr.  Patrick  J.  Golden, 
AFRL/RXLMN,  Project  Monitor. 

References 

lAn g,  A.  H-S.,  and  Tang,  W.H.,  Probability  Concepts  in  Engineering,  Vol.I ,  John  Wiley  &  Sons,  New  York, 
2007,  Ch.  9. 

2Georgiou  A.  George,  “Probability  of  Detection  (PoD)  Curves,”  Health  and  Safety  Executive,  2006. 

3MATLAB,  Software  Package,  Ver.  7.7.0.471  (R2008b) 

4Sanford  R.J.,  Principles  of  Fracture  Mechanics,  Pearson  Education,  Inc  ,  New  Jersey,  2003,  Ch.  9. 

5Shook,  B.D.,  Millwater,  H.R.,  Enright,  M.P.,  Hudak,  S.J.,  and  Francis,  W.L.,  “Simulation  of  Recurring 
Automated  Inspections  on  Probability-of-Fracture  Estimates,”  Structural  Health  Monitoring,  2008. 

6Kulkarni,  S.  Salil,  and  Achenbach  D.  Jan,  “Optimization  of  inspection  schedule  for  a  surface -breaking  crack 
subject  to  fatigue  loading,”  Probabilistic  Engineering  Mechanics ,  2007. 

19 

American  Institute  of  Aeronautics  and  Astronautics 


7Zhao,  Gang,  Vakili,  Pirooz,  and  Borogovac,  Tarik,  “Efficient  Estimation  of  Option  Price  and  Price  Sensitivities 
VIA  Structured  Database  Monte  Carlo  (SDMC),”  2007. 


20 

American  Institute  of  Aeronautics  and  Astronautics 


